Variable selection, monotone likelihood ratio and group sparsity
نویسندگان
چکیده
In the pivotal variable selection problem, we derive exact nonasymptotic minimax selector over class of all s-sparse vectors, which is also Bayes with respect to uniform prior. While this optimal is, in general, not realizable polynomial time, show that its tractable counterpart (the scan selector) attains expected Hamming risk within factor 2, and probability wrong recovery. As a consequence, establish explicit lower bounds under monotone likelihood ratio property obtain tight characterization terms best separable risk. We apply these general results necessary sufficient conditions almost full recovery location model light tail distributions problem group Gaussian noise more anisotropic sub-Gaussian noise. Numerical illustrate our theoretical findings.
منابع مشابه
Joint Variable Selection for Data Envelopment Analysis via Group Sparsity
This study develops a data-driven group variable selection method for data envelopment analysis (DEA), a non-parametric linear programming approach to the estimation of production frontiers. The proposed method extends the group Lasso (least absolute shrinkage and selection operator) designed for variable selection on (often predefined) groups of variables in linear regression models to DEA mod...
متن کاملTesting for the Monotone Likelihood Ratio Assumption
Monotonicity of the likelihood ratio for conditioned densities is a common technical assumption in economic models. But we have found no empirical tests for its plausibility. This paper develops such a test based on the theory of order-restricted inference, which is robust with respect to the correlation structure of the distributions being compared. We apply the test to study the technology re...
متن کاملLikelihood Ratio Tests for Monotone Functions
Ve study the problem of testing for equality at a fixed point in the setting of nonparametric estimation of a monotone function. The likelihood ratio test for this hypothesis is derived in the particular case of interval censoring (or current status data) and its limiting distribution is obtained. The limiting distribution is that of the integral of the difference of the squared slope processes...
متن کاملSTRUCTURED VARIABLE SELECTION WITH SPARSITY-INDUCING NORMS Structured Variable Selection with Sparsity-Inducing Norms
We consider the empirical risk minimization problem for linear supervised learning, with regularization by structured sparsity-inducing norms. These are defined as sums of Euclidean norms on certain subsets of variables, extending the usual l1-norm and the group l1-norm by allowing the subsets to overlap. This leads to a specific set of allowed nonzero patterns for the solutions of such problem...
متن کاملA note on monotone likelihood ratio of the total score variable in unidimensional item response theory.
This note provides a direct, elementary proof of the fundamental result on monotone likelihood ratio of the total score variable in unidimensional item response theory (IRT). This result is very important for practical measurement in IRT, because it justifies the use of the total score variable to order participants on the latent trait. The proof relies on a basic inequality for elementary symm...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Annals of Statistics
سال: 2023
ISSN: ['0090-5364', '2168-8966']
DOI: https://doi.org/10.1214/22-aos2251